Using data mining techniques to explore physicians' therapeutic decisions when clinical guidelines do not provide recommendations: methods and example for type 2 diabetes

<p>Abstract</p> <p>Background</p> <p>Clinical guidelines carry medical evidence to the point of practice. As evidence is not always available, many guidelines do not provide recommendations for all clinical situations encountered in practice. We propose an approach for identifying knowledge gaps in guidelines and for exploring physicians' therapeutic decisions with data mining techniques to fill these knowledge gaps. We demonstrate our method by an example in the domain of type 2 diabetes.</p> <p>Methods</p> <p>We analyzed the French national guidelines for the management of type 2 diabetes to identify clinical conditions that are not covered or those for which the guidelines do not provide recommendations. We extracted patient records corresponding to each clinical condition from a database of type 2 diabetic patients treated at Avicenne University Hospital of Bobigny, France. We explored physicians' prescriptions for each of these profiles using C5.0 decision-tree learning algorithm. We developed decision-trees for different levels of detail of the therapeutic decision, namely the type of treatment, the pharmaco-therapeutic class, the international non proprietary name, and the dose of each medication. We compared the rules generated with those added to the guidelines in a newer version, to examine their similarity.</p> <p>Results</p> <p>We extracted 27 rules from the analysis of a database of 463 patient records. Eleven rules were about the choice of the type of treatment and thirteen rules about the choice of the pharmaco-therapeutic class of each drug. For the choice of the international non proprietary name and the dose, we could extract only a few rules because the number of patient records was too low for these factors. The extracted rules showed similarities with those added to the newer version of the guidelines.</p> <p>Conclusion</p> <p>Our method showed its usefulness for completing guidelines recommendations with rules learnt automatically from physicians' prescriptions. It could be used during the development of guidelines as a complementary source from practice-based knowledge. It can also be used as an evaluation tool for comparing a physician's therapeutic decisions with those recommended by a given set of clinical guidelines. The example we described showed that physician practice was in some ways ahead of the guideline.</p

The GuideLine Implementability Appraisal (GLIA): development of an instrument to identify obstacles to guideline implementation

BACKGROUND: Clinical practice guidelines are not uniformly successful in influencing clinicians' behaviour toward best practices. Implementability refers to a set of characteristics that predict ease of (and obstacles to) guideline implementation. Our objective is to develop and validate a tool for appraisal of implementability of clinical guidelines. METHODS: Indicators of implementability were identified from the literature and used to create items and dimensions of the GuideLine Implementability Appraisal (GLIA). GLIA consists of 31 items, arranged into 10 dimensions. Questions from 9 of the 10 dimensions are applied individually to each recommendation of the guideline. Decidability and Executability are critical dimensions. Other dimensions are Global, Presentation and Formatting, Measurable Outcomes, Apparent Validity, Flexibility, Effect on Process of Care, Novelty/Innovation, and Computability. We conducted a series of validation activities, including validation of the construct of implementability, expert review of content for clarity, relevance, and comprehensiveness, and assessment of construct validity of the instrument. Finally, GLIA was applied to a draft guideline under development by national professional societies. RESULTS: Evidence of content validity and preliminary support for construct validity were obtained. The GLIA proved to be useful in identifying barriers to implementation in the draft guideline and the guideline was revised accordingly. CONCLUSION: GLIA may be useful to guideline developers who can apply the results to remedy defects in their guidelines. Likewise, guideline implementers may use GLIA to select implementable recommendations and to devise implementation strategies that address identified barriers. By aiding the design and operationalization of highly implementable guidelines, our goal is that application of GLIA may help to improve health outcomes, but further evaluation will be required to support this potential benefit

Reshaping Health Care Delivery for Adolescent Parents: Healthy Steps and Telemedicine

This is the publisher's version, also available electronically from http://online.liebertpub.com/doi/abs/10.1089/153056203772744725.Healthy Steps over Telemedicine uses telemedicine technology to bring child development services to adolescent parents in an urban school district. Videoconferencing units link teen parents at a Kansas City high school to developmental specialists and physicians at the Kansas University Medical Center (KUMC). Program participants receive developmental services and valuable health care information without leaving the school. The Healthy Steps goals are to educate parents about health care issues and to help them access medical care for their children and themselves. The telehealth goals are to implement the established Health Steps program effectively over the new medium. This article describes the process of delivering Healthy Steps services via telemedicine, specifically, selection and description of the site, selection of the technology, services provided, research evaluation, and lessons learned

Improving the use of research evidence in guideline development: 13. Applicability, transferability and adaptation

BACKGROUND: The World Health Organization (WHO), like many other organisations around the world, has recognised the need to use more rigorous processes to ensure that health care recommendations are informed by the best available research evidence. This is the thirteenth of a series of 16 reviews that have been prepared as background for advice from the WHO Advisory Committee on Health Research to WHO on how to achieve this. OBJECTIVES: We reviewed the literature on applicability, transferability, and adaptation of guidelines. METHODS: We searched five databases for existing systematic reviews and relevant primary methodological research. We reviewed the titles of all citations and retrieved abstracts and full text articles if the citations appeared relevant to the topic. We checked the reference lists of articles relevant to the questions and used snowballing as a technique to obtain additional information. We used the definition "coming from, concerning or belonging to at least two or all nations" for the term international. Our conclusions are based on the available evidence, consideration of what WHO and other organisations are doing and logical arguments. KEY QUESTIONS AND ANSWERS: We did not identify systematic reviews addressing the key questions. We found individual studies and projects published in the peer reviewed literature and on the Internet. Should WHO develop international recommendations? • Resources for developing high quality recommendations are limited. Internationally developed recommendations can facilitate access to and pooling of resources, reduce unnecessary duplication, and involve international scientists. • Priority should be given to international health problems and problems that are important in low and middle-income countries, where these advantages are likely to be greatest. • Factors that influence the transferability of recommendations across different settings should be considered systematically and flagged, including modifying factors, important variation in needs, values, costs and the availability of resources. What should be done centrally and locally? • The preparation of systematic reviews and evidence profiles should be coordinated centrally, in collaboration with organizations that produce systematic reviews. Centrally developed evidence profiles should be adaptable to specific local circumstances. • Consideration should be given to models that involve central coordination with work being undertaken by centres located throughout the world. • While needs, availability of resources, costs, the presence of modifying factors and values need to be assessed locally, support for undertaking these assessments may be needed to make guidelines applicable. • WHO should provide local support for adapting and implementing recommendations by developing tools, building capacity, learning from international experience, and through international networks that support evidence-informed health policies, such as the Evidence-informed Policy Network (EVIPNet). How should recommendations be adapted? • WHO should provide detailed guidance for adaptation of international recommendations. • Local adaptation processes should be systematic and transparent, they should involve stakeholders, and they should report the key factors that influence decisions, including those flagged in international guidelines, and the reasons for any modifications that are made

The European Society of Human Reproduction and Embryology guideline for the diagnosis and treatment of endometriosis: an electronic guideline implementability appraisal

<p>Abstract</p> <p>Background</p> <p>Clinical guidelines are intended to improve healthcare. However, even if guidelines are excellent, their implementation is not assured. In subfertility care, the European Society of Human Reproduction and Embryology (ESHRE) guidelines have been inventoried, and their methodological quality has been assessed. To improve the impact of the ESHRE guidelines and to improve European subfertility care, it is important to optimise the implementability of guidelines. We therefore investigated the implementation barriers of the ESHRE guideline with the best methodological quality and evaluated the used instrument for usability and feasibility.</p> <p>Methods</p> <p>We reviewed the ESHRE guideline for the diagnosis and treatment of endometriosis to assess its implementability. We used an electronic version of the guideline implementability appraisal (eGLIA) instrument. This eGLIA tool consists of 31 questions grouped into 10 dimensions. Seven items address the guideline as a whole, and 24 items assess the individual recommendations in the guideline. The eGLIA instrument identifies factors that influence the implementability of the guideline recommendations. These factors can be divided into facilitators that promote implementation and barriers that oppose implementation. A panel of 10 experts from three European countries appraised all 36 recommendations of the guideline. They discussed discrepancies in a teleconference and completed a questionnaire to evaluate the ease of use and overall utility of the eGLIA instrument.</p> <p>Results</p> <p>Two of the 36 guideline recommendations were straightforward to implement. Five recommendations were considered simply statements because they contained no actions. The remaining 29 recommendations were implementable with some adjustments. We found facilitators of the guideline implementability in the quality of decidability, presentation and formatting, apparent validity, and novelty or innovation of the recommendations. Vaguely defined actions, lack of facilities, immeasurable outcomes, and inflexibility within the recommendations formed barriers to implementation. The eGLIA instrument was generally useful and easy to use. However, assessment with the eGLIA instrument is very time-consuming.</p> <p>Conclusions</p> <p>The ESHRE guideline for the diagnosis and treatment of endometriosis could be improved to facilitate its implementation in daily practice. The eGLIA instrument is a helpful tool for identifying obstacles to implementation of a guideline. However, we recommend a concise version of this instrument.</p

Designing an automated clinical decision support system to match clinical practice guidelines for opioid therapy for chronic pain

Abstract Background Opioid prescribing for chronic pain is common and controversial, but recommended clinical practices are followed inconsistently in many clinical settings. Strategies for increasing adherence to clinical practice guideline recommendations are needed to increase effectiveness and reduce negative consequences of opioid prescribing in chronic pain patients. Methods Here we describe the process and outcomes of a project to operationalize the 2003 VA/DOD Clinical Practice Guideline for Opioid Therapy for Chronic Non-Cancer Pain into a computerized decision support system (DSS) to encourage good opioid prescribing practices during primary care visits. We based the DSS on the existing ATHENA-DSS. We used an iterative process of design, testing, and revision of the DSS by a diverse team including guideline authors, medical informatics experts, clinical content experts, and end-users to convert the written clinical practice guideline into a computable algorithm to generate patient-specific recommendations for care based upon existing information in the electronic medical record (EMR), and a set of clinical tools. Results The iterative revision process identified numerous and varied problems with the initially designed system despite diverse expert participation in the design process. The process of operationalizing the guideline identified areas in which the guideline was vague, left decisions to clinical judgment, or required clarification of detail to insure safe clinical implementation. The revisions led to workable solutions to problems, defined the limits of the DSS and its utility in clinical practice, improved integration into clinical workflow, and improved the clarity and accuracy of system recommendations and tools. Conclusions Use of this iterative process led to development of a multifunctional DSS that met the approval of the clinical practice guideline authors, content experts, and clinicians involved in testing. The process and experiences described provide a model for development of other DSSs that translate written guidelines into actionable, real-time clinical recommendations.http://deepblue.lib.umich.edu/bitstream/2027.42/78267/1/1748-5908-5-26.xmlhttp://deepblue.lib.umich.edu/bitstream/2027.42/78267/2/1748-5908-5-26.pdfhttp://deepblue.lib.umich.edu/bitstream/2027.42/78267/3/1748-5908-5-26-S3.TIFFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78267/4/1748-5908-5-26-S2.TIFFhttp://deepblue.lib.umich.edu/bitstream/2027.42/78267/5/1748-5908-5-26-S1.TIFFPeer Reviewe

Exposure to revised drinking guidelines and 'COM-B' determinants of behaviour change: descriptive analysis of a monthly cross-sectional survey in England

BACKGROUND: January 2016 saw the publication of proposed revisions to the UK's lower risk drinking guidelines but no sustained promotional activity. This paper aims to explore the impact of publishing guidelines without sustained promotional activity on reported guideline exposure and determinants of behaviour (capability, opportunity and motivation) proposed by the COM-B model. METHODS: Data were collected by a monthly repeat cross-sectional survey of adults (18+) resident in England over 15 months between November 2015 and January 2017 from a total of 16,779 drinkers, as part of the Alcohol Toolkit Study. Trends and associated 95% confidence intervals were described in the proportion of reported exposure to guidelines in the past month and measures of the capability, opportunity and motivation to consume alcohol within drinking guidelines. RESULTS: There was a rise in reported exposure to drinking guidelines in January 2016 (57.6-80.6%) which did not reoccur in January 2017. Following the increase in January 2016, reported exposure reduced slowly but remained significantly higher than in December 2015. In February 2016, there was an increase in measures of capability (31.1% reported tracking units of alcohol consumption and 87.8% considered it easier to drink safely) and opportunity (84.0% perceived their lifestyle as conducive to drinking within guidelines). This change was not maintained in subsequent months. Other measures showed marginal changes between January and February 2016 with no evidence of change in subsequent months. CONCLUSIONS: Following the publication of revised drinking guideline in January 2016, there was a transient increase in exposure to guidelines, and capability and opportunity to drink within the guidelines that diminished over time. The transience and size of the changes indicate that behaviour change is unlikely. Well-designed, theory-based promotional campaigns may be required for drinking guidelines to be an effective public health intervention

Attentional bias retraining in cigarette smokers attempting smoking cessation (ARTS): study protocol for a double bline randomised controlled trial

YesSmokers attend preferentially to cigarettes and other smoking-related cues in the environment, in what is known as an attentional bias. There is evidence that attentional bias may contribute to craving and failure to stop smoking. Attentional retraining procedures have been used in laboratory studies to train smokers to reduce attentional bias, although these procedures have not been applied in smoking cessation programmes. This trial will examine the efficacy of multiple sessions of attentional retraining on attentional bias, craving, and abstinence in smokers attempting cessation. This is a double-blind randomised controlled trial. Adult smokers attending a 7-session weekly stop smoking clinic will be randomised to either a modified visual probe task with attentional retraining or placebo training. Training will start 1 week prior to quit day and be given weekly for 5 sessions. Both groups will receive 21 mg transdermal nicotine patches for 8–12 weeks and withdrawal-orientated behavioural support for 7 sessions. Primary outcome measures are the change in attentional bias reaction time and urge to smoke on the Mood and Physical Symptoms Scale at 4 weeks post-quit. Secondary outcome measures include differences in withdrawal, time to first lapse and prolonged abstinence at 4 weeks post-quit, which will be biochemically validated at each clinic visit. Follow-up will take place at 8 weeks, 3 months and 6 months post-quit. This is the first randomised controlled trial of attentional retraining in smokers attempting cessation. This trial could provide proof of principle for a treatment aimed at a fundamental cause of addiction.National Institute for Health Research (NIHR) Doctoral Research Fellowship (DRF) awarded to RB (DRF-2009-02-15

Development of appropriateness explicit criteria for cataract extraction by phacoemulsification

BACKGROUND: Consensus development techniques were used in the late 1980s to create explicit criteria for the appropriateness of cataract extraction. We developed a new appropriateness of indications tool for cataract following the RAND method. We tested the validity of our panel results. METHODS: Criteria were developed using a modified Delphi panel judgment process. A panel of 12 ophthalmologists was assembled. Ratings were analyzed regarding the level of agreement among panelists. We studied the influence of all variables on the final panel score using linear and logistic regression models. The explicit criteria developed were summarized by classification and regression tree analysis. RESULTS: Of the 765 indications evaluated by the main panel in the second round, 32.9% were found appropriate, 30.1% uncertain, and 37% inappropriate. Agreement was found in 53% of the indications and disagreement in 0.9%. Seven variables were considered to create the indications and divided into three groups: simple cataract, with diabetic retinopathy, or with other ocular pathologies. The preoperative visual acuity in the cataractous eye and visual function were the variables that best explained the panel scoring. The panel results were synthesized and presented in three decision trees. Misclassification error in the decision trees, as compared with the panel original criteria, was 5.3%. CONCLUSION: The parameters tested showed acceptable validity for an evaluation tool. These results support the use of this indication algorithm as a screening tool for assessing the appropriateness of cataract extraction in field studies and for the development of practice guidelines

Effects of automated alerts on unnecessarily repeated serology tests in a cardiovascular surgery department: a time series analysis

<p>Abstract</p> <p>Background</p> <p>Laboratory testing is frequently unnecessary, particularly repetitive testing. Among the interventions proposed to reduce unnecessary testing, Computerized Decision Support Systems (CDSS) have been shown to be effective, but their impact depends on their technical characteristics. The objective of the study was to evaluate the impact of a Serology-CDSS providing point of care reminders of previous existing serology results, embedded in a Computerized Physician Order Entry at a university teaching hospital in Paris, France.</p> <p>Methods</p> <p>A CDSS was implemented in the Cardiovascular Surgery department of the hospital in order to decrease inappropriate repetitions of viral serology tests (HBV).</p> <p>A time series analysis was performed to assess the impact of the alert on physicians' practices. The study took place between January 2004 and December 2007. The primary outcome was the proportion of unnecessarily repeated HBs antigen tests over the periods of the study. A test was considered unnecessary when it was ordered within 90 days after a previous test for the same patient. A secondary outcome was the proportion of potentially unnecessary HBs antigen test orders cancelled after an alert display.</p> <p>Results</p> <p>In the pre-intervention period, 3,480 viral serology tests were ordered, of which 538 (15.5%) were unnecessarily repeated. During the intervention period, of the 2,095 HBs antigen tests performed, 330 unnecessary repetitions (15.8%) were observed. Before the intervention, the mean proportion of unnecessarily repeated HBs antigen tests increased by 0.4% per month (absolute increase, 95% CI 0.2% to 0.6%, <it>p </it>< 0.001). After the intervention, a significant trend change occurred, with a monthly difference estimated at -0.4% (95% CI -0.7% to -0.1%, <it>p </it>= 0.02) resulting in a stable proportion of unnecessarily repeated HBs antigen tests. A total of 380 unnecessary tests were ordered among 500 alerts displayed (compliance rate 24%).</p> <p>Conclusions</p> <p>The proportion of unnecessarily repeated tests immediately dropped after CDSS implementation and remained stable, contrasting with the significant continuous increase observed before. The compliance rate confirmed the effect of the alerts. It is necessary to continue experimentation with dedicated systems in order to improve understanding of the diversity of CDSS and their impact on clinical practice.</p